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OONTROI. PF REMOTE DEVICES USING HTTP PROTOCOL 

Fi«14 OS tuo laveAtion 

This invention relates to methods and iieans 
5 for control of remote devices at remote locations via 
the inteniet preferably using an http protocol, and 
particularly to World Wide Web servers (httpd) (http 
dcuBons) for Ethernet networks. 

Baohground of the invention 

10 The World Wide Web (ww) has become extremely 

popular on the internet as a method of broadcasting 
information to the vorld. In the Sun-EWorld 95 
conference, held in San Francisco, California on May 22 
to May 25, 1995, Sun Microsystems^ introduced its 

15 Internet firewall. Sun Microsystems claimed that its 
httpd (web server) was on board, and the configuration 
of the product could be achieved through any web client 
(http client) . 

summary of the invention 

20 One embodiment of the invention involves 

remote controller firmware for providing httpd service 
(Web server) , and another « the ubg of infra-red and/or 
electromagnetic transmission with the controller. 

According to another embodiment the remote 
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connroller providing httpd service is in the form at a 
firmware device containing a aicroG02q>uter with a 
network interface, electronic interface, and infra-red 
interface. This firmware device receives http requests 
from http clients (web browsers) and replies with html 
(Hypertext Markup Language) documents. Within these 
html documents are buttons, text input boxes, and other 
graphical user interface (GDI) elements that the user 
employs Co manipulate on the http client screen to make 
things happen remotely* The remote controller controls 
and monitors remote devices such as TVs^ air 
conditioners, and VCRs* 

other embodiments, objects, and advantages of 
the invention will became evident from the following 
detailed description of preferred embodiments of the 
invention when read in light of the following drawings. 

Brief Deserlptioa of the Orawimgs 

Figure 4 is a flow diagram illustrating the 
software flow of an embodiment of the invention » 

Figure 5 is a flow diagram illustrating the 
software flow of an embodiment of the invention. 

Figure 6 is block diagram of another 
embodiment . 

Figure 7 is a flow diagram illustrating the 
soft%rare flow of an embodiment of the invention. 
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Figure 8 is a sehenatiic block diagram 
illustrating an emlxxiiment: of the invention. 

Detailed Description of Preferred smbodiaenta 

in Figure 1 an ethemet network connection 
5 NCI connects a user con^iuter UCl to a controller COl 
composed of f irmweire FIX having electronic, 
electromagnetic, and/or infrared interfaces Sll. The 
latter connect the firmware Fll to a nuaaiber of targets 
TAl in the form of appliances/equipments* Targets TAl 
10 are for example VCRs, TVs, and/or air conditioners. The 
controller COl with its firmware Fll and the targets 
TAX nay be at locations remote from the computer COX. 
The network connection NCX nay incXude a coraraerciaX 
telephone utility. 

IB within the user computer UCl, a WWW browser 

WBX includes GUI (graphical user interface) elements 
generally designated GBl such as buttons BUX, a textbox 
TEl, and menus M£l to affect the target. 

Figure 2 is a block diagram illustrating 
20 details of the fimware Fll of Figure 1. Here, a bus 
BUI transfers signals to and from a central processing 
unit CPU CPX, a memory MBl, a non<^oXatiXe Flash RAM 
Fia and a real time clock CKL. The CPU CPX is connected 
to the network connection WCl via an Ethernet interface 
25 EXl, and to remote control via serial interfaces Sll. 

Figtxre 3 is a flow chart illustrating the 
flow of steps and the location of the performance of 
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each st:ep* steps 104 r 110, and 130 tiake place in the 
WWW browser WBl. Steps 107^ ii4, 117, 120, 124, and 
127 take place in the f izmvare FIl of the controller 
GDI. In fitap' 104 the user accessee the URI* (universal 
5 resource locator) . In step 107 an htttl (HyperText 

Mar>cup Xionguage) page is served* Step no is the user 
input to the WWW browser, step 114 involves invocation 
of the in;temal firmware program. This includes steps 
117, 8te]p 120, and step 124. In step 117 the program 
10 effects remote command transmission^ In step 120 the 
firmware collects remote information, and in step 124 
cues future program execution, in step 127 request is 
acknowledged and the execution result sent. In step 
130, the results are displayed in the web browser. 

15 With respect to the firmware ni of the 

controller COl: (1) an httpd resides on the physically 
separate controller apart from the targets and operates 
itself; (2) an httpd code permanently resides in the 
firmware; (3) html pages are uploadable; (4) the 

20 finaware is intended for control and monitoring, not 

setup and configuration; (5) the firmware has interface 
ports (electronic, electromagnetic, and infra-*red) 
dedicated to control other devices* According to an 
embodiment the controller coi controls multiple devices 

25 at the same time. 

The controller coi has an interface in the 
form of a modem and/or an ISDN interface to provide the 
capability of operating over the public network. 

According to an embodiment, fast electronic 


SUBSTITUTE SHEFT (m P 


MflR-26-1998 14:10 ^^CQNTROL TECHNOLOGY CORP 588 435 2373 P. 09/24 

WO 97/18636 


S 


serial ports on the controller COl send and ireceive 
digitally encoded voices and pictures to establish 
virttial phones, fax machines, and telephone answering 
aachiiies over the internet. That is, %ihan someone 
s interacts with the graphical element on the html served 
by the controller COl, it can make a connection through 
the fast serial ports to a digital telephone; when 
someone transfers digitally encoded graphical 

inf oraation to the httpd (Web server) , tbe controller 
10 can send received pictures to the printer through the 

fast serial interface. 

The invention involves use of infra-red 
or/and electromagnetic transmission with the controller 
COl. The controller has an infra-red or/and 

IS electromagnetic transmitter/ receivers to communicate 

with other devices in the proximity, Upon receipt 
of the command from http clients (web browser), the 
controller sends infra-red or electromagnetic signals 
to the. targets TAl. According to embodiments the 

20 targets, lilce vcRs, TVs, or air conditioners, also 

reply or send status information back to the controller 
COl to be received. 

The controller comes with several default 
html pages to control popular devices like a TV. 

2S However, the system is arranged so the end user can 

upload his/her own html documents over the network to 
the controller COl to have a custom controlling 
environment. It is also possible to upload programs to 
the controller to act on the status information from 

30 the controlled devices targets. 
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The application of the controller OOl ie 
extensive. Zn one eatoodiment it controls household 
appliances like a VCR, TV or air conditioner* In 
another esbodijnent it controls and aonitors devices in 
5 remote sensing stations, in another eabodiiaent it 

controls and sonitors secxirity systems for houses, xn 
another enbodisient it controls and nonitors equipment 
on a factory floor. In another emhodiment it controls 
and monitors grectnhouses or aquariums in remote 
10 locations. In another embodiment it controls and 

monitors copy machines^ faxes, and other equipment in 
offices. In another embodiment the controller COl acts 
as a virtual telephone, fax« and telephone answering 
machine on the Internet. 

According to an embodiment the controller COl 
constitutes a stand-alone world wide veb server (httpd) 
for Stbemet networks in the form of a ^firneware^ web 
sezver which is easy to use and fully programmable. It 
is a fir»ware*based World Wide Web Server. According 

20 to an embodiment r the controller coi is a stand-alone 
unit Which contains a high-speed microprocessor in the 
CPU cpi, the Ethernet interface Ell and the Flash RAM 
FUi on a single board. This combination makes it plug- 
and-play ready as well as easy-*to-program for 

25 customized Internet environments, unlike traditional 
Web servers whi^ include a hard drive, monitor and 
keyboard, the invention processes data through 
streamlined firmware which is much less expensive to 
manufacture. This allows one to incorporate the same 

30 advanced features for establishing, maintaining and 
updating a website at a low price. According to an 
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•mbodiaenl:, the controller COl foras a unit whloh 
IncIttdAS a ball-t-in LCD display panel. 

The controller COl i« suitable for corporate 
applications and service providers, it pemits easy 
5 operation, and in an «»*odi»ent is simple to set up and 
install, users nerely connect the unit to the Ethernet 
hub, set an IP address/netaask on the product's built- 
in LCD pinel and the unit is configured to serve Web 
pages to a network. The controller requires that the 
10 network be equipped with a router to provide internet 
access through high-speed Ti, ISW or dedicated lines. 

system software is updated quickly and easily 
via the internet by clicking on the appropriate hot 
button on the system administration web page, served by 
IS the controller. The controller downloads the 
appropriate updates from the Internet host. 

Aocording to an eaibodiment the controller 
COl, in its firawaro ril, includes a Td interpreter 
which allows programmers to cnistosise the server for 

30 many uses. The invention is fully programmable through 
a built-in Td interpreter in ROM. According to an 
embodiment the server (httpd) itself is based on Td 
and uses Td as its source cede. Aceordlng to an 
embodiment the httpd is modified and expanded to meet 

25 the demands of volume users such as VARs and internet 
service providers. According to an embodiment , the 
controller comes with password support, COMmen Gateway 
interface <C6I) scripts for web page authoring, 
text/binary file downloading and file systen 
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nanipulation. Hote Pad groupware application and 
Simple Kail Transfer Protocol (sm&tp) source codes are 
included as smple Tel CGI scripts. 

According to an eabodinent^ the controller 
5 fuxnisbes a tamper proof hardware firewall for network 
security » The controller allows the unit to be placed 
outside of the hardware firewall to serve as a stand- 
alone Web server and to ensure security of a company 
network « According to an embodiment the user sets a 
10 hardware switch to make the Flash RAM read-only. 

Fig. 4 illustrates another embodiment in the 
form of a flow chart showing the flow of steps and the 
location of the performance of each step, steps 404^ 
410, and 420 take place in the www Browser WBl. Steps 
15 407, 414, and 417 take place in the firmware FIl. In 
this embodiment, a telephone oompany has a BBS 
(bulletin board system) listing all telephone nuiabers 
and addresses throughout the country or a region. A 
licensed user who wishes to publish a local phone book/ 
20 or an individual who wishes to update a personal 

telephone book^ uses a URL (Universal Resource Locator) 
to request the phone book from the firmware in the 
controller COl in step 404. In effect the user is 
asking the firmware rii in the controller to retrieve 
25 the number through the web pages. In step 407, the 

firmware Fll returns a form with input boxes and a pull 
down menu. Consequently, in steps 410, the user enters 
the name of the person or company imose telephone 
number he wishes to acquire. In step 414, the firmware 
30 Fll initiates communication with the BBS. In step 417, 
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the f ir«mre ni creates a page with data retirxeved 
from the comunication. In step 420 the user views the 
results and determines whether it should be placed in 
the local or personal directory. 

The integrated local phone book program keeps 
the queried phone numbers, so that the same query does 
not initiate another transaction to hone company BBS. 
The user isan click on the entries on the local phone 
book to have the controller frimware initiate the phone 
call by using the modem, or have the controller COl 
communicate through serial port to PBX to have the call 
placed for the user. 

According to an embodiment anyone in an 
Office (intranet) can access the controller firmware to 
get the phone number and also can look for new nuBbers 
with this new feature. 

The controller strategy in the way that is 
base on a firmware based server and programs are 
preinstalled. 

According to an embodiment, the controller 
COl periodically polls daily TV program listing from a 
central server (e.g. TV station web pages) using HTTP 
protocol. The controller COl is acting as a web client 
at this time. Alternatively, the controller utilizes 
25 data broadcasting service to receive TV listing to be 
used in the operation. The controller COl processes 
the received TV listing and creates a web page with 
buttons and pull down menus to facilitate the user 


15 


20 
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interface. Using this veb page served by the 
controller COl, the user can turn on TV, select: channel 
on the operate VCR, and program VCR (video cassette 
recorder) to i^ecord the future TV programs. As an 
5 option, the controller coi stores the TV selection/VCR 
prograaoaing data on the flash memory to be delivered or 
polled to/ from TV ratings services. This arrangement 
appears in the flow chart of Figure 5. 

In Fig, 5 the flow chart is divided into 4 
10 columns, namely user, controller, TV listing websites, 
TV/VCR. Each step is placed in the column in which the 
step occurs. 

steps 514 and 520 occur in the users web 
browsers WBl. Steps 504, 510, 517, and 524 take place 
15 in the controller COl. steps 507 and 524 take place in 
a TV listing website » Step 529 takes place in the 
TV/VCR. 

In step 504 the controller COl periodically 
polls the daily TV program listing from a central 
server, namely TV listing websites or pages. In step 
507 the TV listing websites serve the TV listing to the 
controller COl. The controller COl, in step 510 
process and stores the listings. In step 514, the user 
uses the web browser WBl to access the TV listing URL 
(universal resource locator) of the controller C01« 
The controller serves the TV listing page, in steps 
517, with controls. In step 520 the user clicks on the 
program listing to operate the TV or VCR. And passes 
this information to the controller COl. In step 524 


20 


25 
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tha controller transaits mn inferred 8i9nal to operate 
the TV/VCR nov or later according to uaer preference, 
in step 527 the TV/vcR ahova channel or program* 

rlg« 6 illuatrates another eabodiaent of the 
5 ayatea shown in Fig* 1. Here, one of the target 
appliances is a global positioning system (GPS) 
receiver* The GFS receiver may be on a moving vehicle 
or ship 'Either in communication with the controller or 
the entire controller OOl %rith the CPS receiver may be 
10 on a moving vehicle* 

The operation of the CPS receiver with the 
controller and the user computer appears in Pig. 7. 
Here, the steps are placed in columns representing the 
location of where the steps take place. In step 704, 

15 the GPS receiver CPi receives data and transmits the 
data to the controller via a serial port* In steps 
607, the controller processes , summarizes and atores 
the data in a DRAM or flash memory MEl* The user 
computer UCl queries the GPS data in step 610, and in 

20 step 614, the frimware on the controller COl returns 

the data* The controller receives: the updated GPS data 
every second from the GPS receiver connected through 
the serial port* The controller 001 processes, 
Aunarizes, and stores the data in the memory MEl* The 

25 computer UCl controls numerous controllers COl 

synchronously to receive the data through TCP/IP 
(transmission control protocol/ internet protocol) 
connections. Using the data in the centralized system, 
one obtains very accurate geographical data from the 

30 GPS syetem. Fig* 8 illustrate a system where a number 
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Of oontrcXlers COl connect to tbe user ooaqputar Uci. 

me controller COl constitutes a flrmare 
based vw server. Tho CFO say for exaa^le be a high 
speed aicroporcessor. 

5 Hhile esbodinents of the invention have been 

described in detail, it will be evident that the 
invention may be embodied otherwise without departing 
from its spirit and scope. 
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m&at: Is claimed ist 


!• Apparatus for control of reaote devices, 
coHprising: 

a cduputeri 

5 an ethemet networlc coupled to said cooputer; 

a remote controller firmware providing httpd 
service x:bupled to said network; and 

infra-red and/or electro&a^netic transmission 
coupling the controller finnware with the devices « 


SUBSTITUTE SHEET (pUUE2fi) 


.rW-26-1998 14: 12 
W097/1M96 


CONTROL TECHNOLOGY CORP 


508 435 2373 P. 18/^4 
FCT/IBM81495 


1/7 


HGUREl 


UC1 


WB1 

8U1 
Tgl 


USER COMPUTER 



NCI 


QUI ELEMSMTS^ 
UKE BUTTONS. 
TEXTBOX,AND 
MENUS TO 
AFFECT THE 
TARGET 

SSI 


ME1 


C01 


FIRMWARE 


T — ^ 


■I 


FI1 


f 


SI1 


ELECTRONIC/ELECTROMAONETIC 
OR INFRARED irOERFACES 



TA1 



SUBSTITUTE SHEET 0tUl£ 26) 



SUBSTITUre SHEET O^UUE 2S) 


MfiR-26-1998 14:13 ^^ONTROL TECHNOLOGY CORP 508 435 2373 P. 20/24 

WO 97/1 PCT/IB96/D1435 


3/7 
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